Abstract 



Memristors have been compared to neurons (usually specifically the synapses) 
since 1976 but no experimental evidence has been offered for support for this po- 
sition. Here we highlight that memristors naturally foim fast-response, highly re- 
producible and repeatable current spikes which can be used in voltage-driven neu- 
romorphic architecture. Ease of fitting current spikes with memristor theories both 
suggests that the spikes are part of the memristive effect and provides modeling 
capability for the design of neuromorphic circuits. 
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1 Introduction 

Neuromorphic computing is tiie concept of using computer components to mimic 
biological neural architectures, primarily the mammalian brain. Although an area 
of current and active research, we do not know exactly how the brain works, how- 
ever it is believed that the brain is a neural net. Signals travel along neurons via 
voltage spikes known as action potentials which are caused by the movement of 
ions across the neuron's cell membrane, and the signals pass between neurons via 
chemical neurotransmitters (the gap crossed between neurons is the synapse) 1 1 1. 
The interaction of these spikes is thought to be a cause of brain waves, thought, 
learning and cognition. The long-term potentiation of neurons is related to a 
change in structure of the synaptic cleft, which is thought to result from the Spike 
Time Dependent Plasticity (STDP) of these synapses and result in Hebbian (asso- 
ciative) learning |2|. 

The memristor is the 4"^ fundamental circuit element as predicted by Leon 
Chua [3J. First reported experimentally using this terminology in 2008 |i4J, mem- 
ristors have been an object of scientific study for at least 200 years (5). Memristor 
theory was first demonstrated in a model of the action of nerve axon membranes 
in 1976 1 6 1, which was proposed as an alternative to the Hodgkin-Huxley circuit 
model) and this has led to the suggestion that they would be appropriate compo- 
nents for a computer built using a neuromorphic architecture [4J. Several simu- 
lations of neural nets containing memristors have been performed (see for exam- 
ple [7|). Recently, it was reported that circuits combining two memristors with 
two capacitors could produce self-initiating repeating phenomena similar in form 
to brain waves |8 |. 

Perhaps it is not merely the case that memristor models fit neuron behavior, 
but that neurons themselves are memristive. Thus, we would expect that advances 
in the study of memristors would explain neurological phenomena (as happened 
with computer science and STDP). A circuit theoretic analysis of an updated ver- 
sion of Hodgkin-Huxley 's model of the neuron has been undertaken Ii9l ll0l . The 
Hodgkin-Huxley model is often used to explain the transmission of voltage spikes 
along the neuron. However, this model predicts huge inductances which are not 
experimentally observed in biology and it has been demonstrated |9| that updat- 
ing the Hodgkin-Huxley model with memristors avoids this requirement. A recent 
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paper suggested that memristance could explain the STDP in neural synapses ||2]- 
The authors used memristor equations to adjust simulated spikes, found a similar- 
ity to experimentally measured biological synapse action Hill and concluded that 
a memristive mechanism was behind the biological STDP phenomenon. 

In this paper we will show experimentally that memristors spike naturally and 
do not require a spiking input to cause them to spike in a manner qualitatively sim- 
ilar to neurons. We shall attempt to quantify the spikes. We will then demonstrate 
that these spikes are also present in theoretical models of memristors and discuss 
the cause of them. We think that utilizing these naturally-occurring spikes will be 
the most fruitful way to create neuromorphic memristor architectures. 



2 Properties of Memristor Spikes 

Memristors come in two flavours, charge-controlled (left) and flux-controlled (right) 
as shown below in Equation|2]where q is the charge, tp, is the magnetic flux, M is 
the memristance and W is the memductance (inverse memristance) ||3] 

V{t) = M{q{t))I{t), I{t) = W{^{t))V(t) . 

For a charge-controlled memristor we would input a current, J, and measure 
the voltage, V. Biological neurons may be described as charge-controlled because 
it is the movement of ions that causes the change in voltage giving rise to a voltage 
spike. Our memristors are flux-controlled and a change in voltage causes a spike 
in the current. Thus, creation of a neuromorphic computer with memristors will 
be using the complimentary effect to the one utilized by nature, in that memris- 
tors have voltage-change-caused current spikes and neurons have cuiTent-change- 
caused voltage spikes. That both types of spikes have a similar form arises from 
the similarity in the underlying electromagnetics, in that circuits can considered as 
being constructed with either a voltage source or a current source. 
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Figure 1: Current spikes recorded from a memristor subjected to the voltage square 
wave in figure |2] The spike heights are highly repeatable and qualitatively resemble 
neuronal spikes. 
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ure 2: Voltage square wave that the memristor measured in figure [T] was subjected 



Our memristors are flexible sol-gel titanium dioxide gel layers sandwiched be- 
tween aluminium electrodes 1121 1131 and they show a distinctive large spike that 
occurs when the voltage is changed. The experiments reported here were carried 
out with a Keithley 2400 sourcemeter sourcing voltage. There are no spikes in 
the voltage profiles, (see Figure |2) and no current spikes are seen when the same 
experiment is done across a resistor It has been suggested that these spikes are 
capacitance; however the timescale is too long. The spikes have been reported by 
other groups in their memristors (see for example, [ 14 ), however they are usually 
overlooked or attributed to artefacts arising from the experimental set-up or not 
reported at all (many researchers only report the I — V curves to demonstrate that 
they have a memristor). However, the current spike is an equilibrating process that 
is responsible for the frequency dependence of the I — V curves. In Figure|2]each 
voltage step had 40 timesteps (~ 3.3s) to equilibrate. If the voltage is scanned 
quicker than this, the current has not equilibrated and thus current is higher than 
the equilbration current. Thus, a faster switching time increases the hysteresis of 
the I — V loop. This effect increases with frequency until it reaches the limit 
where the voltage frequency is too fast for the memristor to relax at all and the 
I — V curve just traces out the maximal spike currents for each voltage. 

These current spikes can be seen whenever a voltage change occurs across 
the memristor Unlike some neuronal spikes, the voltage does not need to spike. 
The current spikes are highly reproducible. For the experiment shown in Figure[T] 
(10 pairs of positive to negative switches), the standard deviation was 0.0729% of 
the mean for the negative voltages (where n — 10) and 0.1192% of the positive 
voltages (where n — 9, due to incomplete recording of the first spike)). For the 
repeated spikes in figure |3] (3 repeats each of both positive and negative ramps, 
as shown in figure |4j the largest difference between the spike current repeats was 
only 3.06X 10^'' A and only 2.33 x 10"^" A for the equilibrated current - both taken 
from the positive side as it has a larger hysteresis than the negative side. 

The direction of the current spikes is related to the change in voltage, not its 
sign, so a change from a positive voltage to zero (turning the voltage source off) 
gives a negative spike and vice versa for a negative voltage to zero. The spike 
current still flows for a short while after the voltage source has been turned off. 
This lag is a general thing and has been recorded in several different devices. In 
different devices the spikes are the same shape and seem to be following similar 
dynamics. The spike current is proportional to the equilibrated current. Intrigu- 
ingly, spike shape closely resembles that of Bi and Poo's experimentally observed 
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STDP function 1111 and thus could be used to perform a similar function. 

2 
1.5 

1 - 

< 




5 10 15 20 25 30 35 

Time/ s 

Figure 3: The spikes for 5 successive runs up and then down the voltage staircase shown 
in figure |4] The runs are coloured and overlap. The spikes are highly reproducible on 
successive runs 
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Figure 4: Voltage ramps for figure |3] 5 sets of positive voltage ramps-negative voltage 
ramps were run, to give the spike response in figure |3] 



3 A Mathematical Description of the Spikes 

Figure |6] shows the I ~ t response of a single spike to a voltage step like that 
shown in figure|5] The current spikes are roughly the same shape, and thus we can 
make some statements about the nature of the current spikes in memristors, which 
should also relate to the voltage spike in neurons. As shown in figure |6] there is a 
steady-state current, ioo, a spike current io and a transition between the two which 
is a time-dependent transient i{t). We don't currently know if the i{t) is dependent 
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Figure 5: An example of a voltage step as applied to a memristor. 




Figure 6: An example Spike. Red dashed line: T50; orange dotted line rgo; green 
dot-dashed rgs; blue dotted T99. Horizonal purple dot-dashed line is Zqo and the spike 
height is io. 
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Figure 7; The resistance profile for the memristor subjected to the voltage in figure |5] 
Note that the 'zero' resistance is due to zero measured resistance as no voltage is ap- 
plied, not a true zero resistance. 

on io or not. We do know that io is related to ioo- Until a thorough experimental 
study is undertaken, we shall assume that i{t) is not dependent on io as this is what 
the experimental evidence seems to suggest. 



Thus, the time-dependent current response, I{t) is assumed to be of the form: 



where io < i{t) < 0. 

The current response to the voltage is thus: 



The time taken to get to i{t) = the equilibration lifetime which we shall 
call T, and this lifetime is the short-term memory of the memristor and relates 
to its dynamical properties; from longer time spike studies with our devices, we 
know that r is approximately 3.3s. We shall define the concept of the equilibra- 
tion frequency as the 'frequency' associated with changing a descretised triangular 
voltage waveform such that each voltage step n lasts for r seconds. 

We know that 



This number includes all the charge carrying species in the system. Knowledge of 
this number may help us elucidate the mechanism of the spikes. For our example 
system shown in figures|6] we have an io of 1.37x 10~*A, an ioo of 2.40 x 10"^" A, 
with the Tso of 0.56s and an rgo of 0.84s, which shows how quick the fall off is 
(and T95 of 1.13s and rgg of 2.34s, as drawn in figure|6). The resistance profile for 



I{t) = ioo +i{t) 




I{t)dt. 



thus, the total measured charge in a memristor spike is 
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the memristor subject to a voltage step as shown in figure |5]is shown in figure [7] 
This is approximately a straight-line which is interesting as it is not required to 
be by memristor theory and tells us that the spike current response depends on a 
quantity in the system that is varying with linearly time. 

4 The Mem- Con Theory as AppUed to Mem- 
ristor Spikes 

The mem-con model of memristance f 161 is a recently announced theoretical model 
that relates real world q and <^ to Chua's constitutive equations and has been suc- 
cessful in modeling our memristors 0171 . The mem-con theory has the concept of 
a memory property, the physical or chemical attribute of the device that holds the 
memory of the device. In titanium dioxide (and many others) it is related to the 
number of the oxygen vacancies. The presence of oxygen vacancies allows the 
creation of a doped form of titanium dioxide Ti02-a: which is more conducting 
than the undoped (Ti02) form. The mem-con theory requires that we calculate the 
memristance from the point of view of the memory property, i.e. the ions. 

Theoretically, the voltage step is a discontinuous function and the voltage 
changes from voltage A, Va to voltage B, Vb in an infinitesimal, i.e. /S.V — 
^b->Va ^ Sf^ Experimentally this is not the case of course, but the response 
timescale of the memristor is long enough that we needn't worry about this ap- 
proximation. 

Thus to elucidate what happens to the memristor during a current spike, and 
how the final current ioo is determined, we take differences of the mem-con theory. 
We shall assume our device is a Ti02 memristor, with oxygen vacancies acting as 
the memory property 0161 . 

As a reaction to the voltage step, we get a current spike, Ai, which can be 
expressed as a volume current within the device as A J as given by; 

AJ = {^M^,0,0} 

vol 

for vacancies moving in the +x direction where is the charge in that volume 
due to the vacancies, /ii, is the ion mobility of vacancies and L is the average 
electric field causing the movement of the vacancies and vol is the volume full of 
moving ions. The change in the magnetic field at point p, AB{p) would then be: 

ABM - ^ I (1) 

where /io is the permittivity of a vacuum, J and f are the unit vectors for J 
and f where r is the vector of length r from the volume infinitesimal dr to point 
p, given byr = {rxi,ryj,r^k}. 

Thus, to get a measure of the effect of the spikes, we need to solve this inte- 
gral over a time-interval covering from the start of the spike to the tail-off of the 
memristor's response. The voltage input is non-integrable, but we can integrate 
from the start of the step, which we shall take as t{n) where n is the number of 
the voltage step, which is zero for this case if it is understood that this is not the 
zero at the start of an experiment with many steps (i.e. we are considering a case 
as in figure |6j to when the memristor has responded, which we shall take as T. 
Dependent on the situation T can be one of many values, for a staircase we would 
presumably want T — t{n + 1) where t{n + 1) is the time that the voltage step 
is input. For a response to a single step function we could take the integral out to 
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oo (which is what we shall do here). For experimental purposes we might be more 
interested in integrating to r or rgo. 
Solving the integral gives: 

AB{p) = ^L/x„Ag{0, -xzPy^xyP^} 

with 



Py 



2(Aw2 +£2 + F2)2 

1 (^AwE(^F^E^+F^f +a + b)) 



+F arctan 
and 
P. = 



2AwEF 

AirU 



fVavPTWTf^ 



2(Aw2 + F2 + F2)2 

^ (^AwF(^E^E^ +F^y +a + bj) 



2AwEF c 
AwF 



+E arctan 



EVAnPTWTF^ 



where 



a = Aw'^ {2E^ + F^) 
b = Aul^ {2E^ + 5E'^F'^ + 2F^) 

c = (Aw' + f') (f' + f'') (Aw' + F" + F") ^ . 

Where the effect on the magnetic field is due to both the influx of charge and 
the resulting movement of the boundary between doped and undoped Ti02. 

To calculate the change in magnetic flux through a surface associated with this 
field, ip, we need to take the surface integral 

J ^B- dA 

where dA is the normal vector from the surface infinitesimal dA. 

As it is a surface integral, to calculate the magnetic flux we need to pick a 
surface to evaluate over. It makes sense to choose a surface that correlates to one of 
the surfaces of the device. Picking the surface just above the device (0 < x < D, 
Q < y < E, z = F), we use the surface normal area infinitesimal, dA, which is 
given by dA = {0, 0, ij}. As is standard in electromagnetism, we integrate over 
the entire area. The limits of the surface are taken to be the dimensions of the 
device. 

Thus we derive the general form of the magnetic flux passing through a surface 
i-j: where, because ip is entirely dependent on q, which is time-varying, we can 
include the time varying effects by taking the differentials thus 

5ip= ^Ln^ijPkSqv , (2) 

And, as in mem-con theory [?], by using Chua's constitutive relation for the 
memristor, we can then arrive at the change in the Chua memristance as experi- 
enced by the ions: 
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A A/, (Ag„ (t)) = UXn^APk (Ag„ (t)) , (3) 

where we have gathered up the constants and exphcitly included Pk's dependence 
on qy. 

Equation[3]can be considered as tiiree separate parts: 

1. f/, the universal constants: 

2. X, the experimental constants: DEL. 

3. the material variable: HvPk (called /3 is ref [!!Mem-Con]), this includes the 
physical dimensions of the doped part of the device and the drift speed of 
the dopants. 

Writing out the differences explicitly of equation |3] we end up with: 

M{B) = M{A) + UXfi^Pkigs) - PkiqA)], 

which allows us to calculate how the final Chua memristance from knowledge 
of the peak and final cuiTents. The Chua memristance is written for the vacancy 
charge, so to put it into the standard format for the electronic current we need to 
scale it thus: 



Rm = CmM, 

where Rm is the electronic resistance of the doped part of the memristor and Cm 
is a fitting coefficient. 



4.1 Conservation function 

The memory part of the function only describes the effect of the memristance 
change on the doped part of the memristor. To cover the other one we use the 
conservation function, this is most easily expressed in terms of w{t), but w(t) is 
related to q{t) by 

Thus, the difference in conservation function, Aiicon, written as a difference 
equation is: 

R...iB) = R..4A) + iD-HB)^Hmpo. 

which based on the definition of resistivity and where poff is the resistivity of 
the undoped part of Ti02 . 

The mem-con model describes a memristor by being the sum of the memory 
and conservation functions (both written for the electrons) and this then gives us 
the following expression for the change in time- varying resistance, R{t), as mea- 
sured after a change from Va Vb as: 



/\R{t) = CmM{A) + R,on{A) + ^^ 

+CMUX^ly[pk(qB(t)) -Pk{qA{tT))] 

Lpoff^J.v[qB{t) - qAitr)] 
where we have substituted for w. This equation has two parts: 
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1. S, the time-invarient part, which is: 

c„,M(A) + R,on{A) + ^ 

2. Y, the time variant part: 

CMUXn^lpkiqait)) - PkiqAitr))] 
Lpanti^ [qb W-Qa (*r)l 

the last two terms which are both dependent on q (remember pk is dependent on w 
but can also be written in terms of q. 

In the above equation |4] highlights a few subtleties of the model, pk and q are 
time-dependent and thus change after the voltage step from Va — > Vs . If we ask 
the question of what the difference will be between the equilibrated current at Va 
and that at Vb, ARA^-tB^a equation|4]collapses to: 



AR = c,„A/(yl) + J?eo„(A) + ^^ 

+CMUX^i^[pkiqB{T)) - PkiqAir))] 
LpotflJ.v[qB{T) - qAjr)] 

which is time invariant and allows us to predict the value of the equilibrated current 
after a voltage step from the equilibrated current from the step before. 

What if there was previous step in which the device did not equilibrate to ioo ? 
This would happen if the voltage was changed quicker than r, i.e. T where T < t. 
The qAitr) is not <?a(t") and thus needs to be shifted by its value as a proportion 
of T. As an example, if we sped the voltage ramps up to 90% of the equilibration 
frequency, qa would be qAirgo) and the length of a time step would be rgo. At 
first glance it might appear that this would merely modulate the starting point for 
qs (t), which, at times under t < t, this would be time dependent. But there is the 
interaction between qB (t) and qA (tr), the memristor hasn't finished responding to 
Va and that response should be mixed in with Vb, further complicating predictive 
efforts. 



5 Modeling Memristor Spikes 

The mem-con model consists of sum of two components: the memory function. 
Me, and Conservation function. Re- The memory function has a fitting parameter 
Cm within the model to account for the conversion between the material's resis- 
tance as for an oxygen vacancy and as for an electron. The conservation function 
has the fitting parameter Cc which accounts for the resistivity of the undoped ma- 
terial, poff, which may not be the same as the bulk titanium dioxide. Ron is the 
final fitting parameter and relates to the resistivity of the doped material, which is 
the memristor in the equilibrated state and any resistance in the wires. The fitted 
equation is 



^ ^ Ron CcRc{t) - CmM^t) • 

As figures[8]and|9]shows, the mem-con model fits these spikes quite well and 
much better than an exponential fit. For the positive spike, cm — 3.83 x lO'', 
Cc = 1.76 X 10^ and V/Ron = 2.97 x 10~^, with a summed square of residuals 
of 1.61x10"". For the negative spike, cm - 1.06 x 10®, Cc = 1.86 x lO"** 
and V/Ron = —3.16 x 10~^, with a summed square of residuals of 1.63 x 10~^^. 
For the exponential fit, I{t) = Ae^^, and A — 3.96, A — —19.5 with a summed 
square of residuals of 2.43 x 10^^^. The exponential fit could be fit to either the 
short time spike or the long time tail but not both, the short term spike fit goes 
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erroneously to zero and the long-term spike fit grossly over-estimates the size of the 
spike. Furthermore, there is no experimental justification for using an exponential 
fit, unlike the mem-con fit. This model can be utilized to perfoiTn simulations of 
memiistor spiking networks to test out possible neuromorphic architectures. 



14 
12 
10 



Experimental data 

- Mem-con theory fit 

- Exponetial fit 



50 100 150 200 250 

Time / s 



Figure 8: A longer-term spike response fit by the mem-con theory. The mem-con 
theory fits the experimental data well, the best result fitting the data with an exponential 
is added as a comparison. Blue dots: experimental data, red line: mem-con fit, green 
line: exponential fit to the spike. 



6 What is the Mechanism? 

The memoiy property of these memristors is the oxygen ions, usually viewed as 
positive holes in a semi-conducting material. We suspect that the motion of these 
ions is behind both the spikes and the memristance as we postulate that the two are 
the same phenomena. The current that flows at t = Os may be the ionic current, 
which would have a greater inertia, and thus takes longer to stop compared to the 
electrons, which may explain the cause of the devices hysteresis. This current flow 
can also explain the open-loop memristors (suggested by Pershin and di Ventra 1 1 8 1 
to explain experimental results such as 1191 which are similar to ones seen in our 
labs and others'). The spike shape would then be the result of the equilibrating of 
the ionic cuiTent to a change in voltage. We expect that the timescale and dynamics 
of the spikes will relate to the frequency effects seen in memristors. However, there 
is much further experimental work to be done to prove this mechanism. 



7 Comparison between memristors and neurons 

Chua's definitions of his two types of memristors, flux and charge controlled, was 
given above. The mem-con model has the concept of a two-level system where 
we have two charge carriers, q, our memory property and e~ the electronic cuiTent 
which is what is measured in an experiment. Level is the relationship between the 
vacancy charge, q and vacancy flux, tp. This is experienced at level 1 by resistance 
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Figure 9: A longer-term negative spike, demonstrating that the negative spikes are fit 
equally well by the mem-con theory. Blue dots: experimental data, red line: mem-con 
fit. 

changes (R{t)) which effect the electronic current, I^- . The circuit measurables 
are the voUage, V and the total current / where 1=^+1^-. 

For our memristors, driven by a voUage, the right hand side of figure [TO] sum- 
marizes the operation. There is a change in voltage, which acts on the electrons 
and the vacancies, causing a change in the number of charge carriers (Ae~ and 
Aq. The change in q causes a change in the magnetic flux associated with q and 
thus a change in the Chua memristance. This, due to the conservation of space, 
causes a change in the amount of material described by the conservation function 
Rc, which then changes the total resistance A_R. This change in resistance will 
draw more current, and thus the change in the number of electrons is influ- 
enced by both the change in voltage and the change in resistance that change has 
caused. The change in total current is due to both the electrons and the vacancies. 

A neuron is the opposite way round, see the left hand side side of figure [Tol 
The cell is always pumping ions back and forth, so we have a change current due 
to an influx of charge carrier This causes a change in magnetic flux and affects 
the total resistance (the values of the memory and conservation functions for this 
system have not yet been worked out). This change in resistance causes a voltage 
spike. Thus, similarities can been seen between neuronal voltage spikes and mem- 
ristive current spikes, in that they are the opposite way round with respect to the 
circuit measurables, in that the memristor as operated here is a current response to 
a voltage-sourced circuit, and the neuron is a voltage response to a current-sourced 
circuit. Essentially the shape of the circuit variable, i.e. that which is being mea- 
sured, is qualitatively similar 

8 Towards Neuromorphic Computing 

It has been suggested since 1976 that neurons are memristive, but experimental 
evidence for neuron-like spiking in memristors had not been collated or analyzed in 
this way before. If this spiking behavior is an integral result of memristance then it 
is evidence for the suggestion that neurons may be memristive in action and further 
understanding of memristor theory may further the neurological understanding. 
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Figure 10: Scheme 



This work shows that to make neuromorphic computers that compute with 
spikes memristors are an obvious choice for this task as they spike naturally. Inter- 
ruption to the equilibrating current curves as shown in figure [!3], by, for example, 
changing voltage, would potentiate the connection by modifying the memristance 
and could thus be used to do STDP with memristors without requiring CMOS 
neurons to generate the spikes. 



9 Conclusion 

Memristors, when subject to a change in voltage, undergo a current spike. This 
spike has been shown to be reproducible and repeatable. The mem-con theory 
have been shown to fit the time-dependent current behaviour with only two fitting 
parameters (which come from the missing material values in the theory) suggest- 
ing that this I — t spike behaviour is an aspect of memristance. Rewriting the 
mem-con theory as a difference equation allows the formulation of a predictive 
equation to related the equilibrated currents at different (and successive) voltages. 
Application of the equilibration lifetime (t) to this equation highlights where the 
time-responsive interactions might arise in a memristor switched faster than the 
equilibration frequency. 
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